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@ Image motion vector detecting apparatus. 

@ An image motion vector detecting apparatus includes a 
low-pass filter (12, 12') for suppressing a spatial high frequency 
component of an image signal in one or both of the horizontal 
and vertical directions, and a high-pass filter (13) for suppress- 
ing a spatial low frequency component of an image signal in one 
or both of the horizontal and vertical directions. Using an image 
signal which has passed through the filters, a correlation value 
for discrete shifts Is obtained through a matching operation. 
Based on the obtained correlation values, a correlation value for 
continuous shifts is estimated through interpolation process- 
ing. A shift having a minimum correlation value is calculated to 
detect an image motion vector. 
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Description 

IMAGE MOTION VECTOR DETECTING APPARATUS 



BACKGROUND OF THE INVENTION 
5 The present invention relates to a motion vector detecting apparatus for detecting a motion quantity of an 
image based on a moving image signal. 

DESCRIPTION OF THE RELATED ART 
As a method of detecting a motion quantity of an image based on a moving image signal, there is known a 

10 matching method using representative points. According to this method, there are provided a plurality of 
representative points in a motion vector detetion area within the image frame. An absolute value of a difference 
between signals at the current and preceding fields within a detection region surrounding each representative 
point is calculated. The absolute values are accumulated with respect to each relative position of a 
representative point. A relative position which takes a minimum accumulated value is regarded as a motion 

15 vector. This matching method is also called a representative point matching method. Fig. 12 is a block diagram 
showing a motion vector detecting apparatus which uses the above-described representative point matching 
method. As shown in Fig. 12, the motion vector detecting apparatus is constructed by an image signal input 
terminal 1 , a representative point memory 2, a subtracter 3, an absolute value converter 4, a cumulative adder 
5, and a minimum value point detector 6. Fig. 11 is a schematic diagram showing representative points within 

20 an image frame and their detection regions, respectively used for the motion vector detecting apparatus 
shown in Fig. 12. In Fig. 11, each of reference numerals 7 and T represents a representative point, 8 and 8' an 
interval between representative points, 9 and 9' a magnitude of a detection region, and 10 and 10' a detection 
region represented by its representative point. Figs. 10(a) and 10(b) are schematic diagrams each showing a 
table which stores therein cumulative values calculated by the cumulative adder 5 of the motion vector 

25 detecting apparatus shown in Fig. 12. 

The operation of the motion vector detecting apparatus constructed as above will be described. Time 
sequential image signals for each field are applied to the image signal input terminal 1. In cooperative 
association with the representative point memory 2, a plurality of representative points 7, T are predefined 
within the detection area of the image frame as shown in Fig. 11. The representative point memory 2 is 

30 therefore adapted to store therein pixel signals of the inputted image signals at the representative points. 
Upon inputting of image signals of the next field, the substracter 3 obtains a difference AL(i,j) between a pixel 
signal at a representative point at the preceding field and a pixel signal at the current field shifted by i in the 
horizontal direction and by j in the vertical direction from that representative point. Here, the i and j are 
quantized values with a quantization interval of one piexel in the horizontal direction and one line in the vertical 

35 direction, respectively, within a detection range. The absolute value converter 4 converts the difference into an 
absolute value |AL(i,j)|. The absolute value |AL(i,j). for a signal difference with respect to a shift (i,j) is 
obtained for every representative point. The cumulative adder 5 cumulatively adds signals from the absolute 
value converter for each shift (i,j) and stores them in its table as shown in Fig. 10(a). Each cumulatively added 
value i AL(i,j). is used as a correlation value for a shift (i,j). The minimum value point detector 6 detects a shift 

40 (i\j') which takes a minimum correlation value. The shift (!',]') is outputted as a motion vector. 

The representative point matching method operating as above has the advantages that an operation of 
obtaining a correlation value by shifting one of the images between the preceding and current fields as in a 
fundamental matching method can be dispensed with, and that the amount of calculation can be reduced by 
decreasing the number of representative points. In addition, as shown in Fig. 11, the parallel processing for 

45 matching calculation can be dispensed with by setting the interval 8, 8' between representative points equal to 
the magnitude 9, 9' of a detection region so that the detection regions 10, 10' represented by respective 
representative points are not superposed one upon another. Further, by setting the detection regions 
represented by respective representative points so as to superpose one upon another to a limited degree, the 
amount of the parallel processing for the matching calculation can be made small, thereby allowing to realize 

50 the motion vector detecting apparatus more easily. . 

The image motion vector detection apparatus constructed as above, however, has the following problems. 
First, since a correlation value is obtained by using only a pixel signal at the representative point, a reduction 
in the number of representative points results in a susceptibility to noise effects and a higher possibility of 
detecting an erroneous motion vector. In addition, there occurs often a case where a motion vector cannot be 

55 detected if the change of image signals is concentrated such as on an edge portion of a step waveform but it is 
small in the most area of the other image signal field. For this reason, the number of representative points 
cannot be reduced sufficiently in practice, still requiring a great amount of calculation and parallel processing. 
For the same reason, it is difficult to make the detection region large in such a motion vector detecting 
apparatus. 

60 Furthermore, since a correlation value is calculated based on an absolute value of a difference between 
image signals, an erroneous vector is detected with a very large possibility if the reference level of an image 
signal varies between respective fields or if the contrast of image signals varies. 
Still further, since correlation values are obtained for equantized shifts and a shift, for which the smallest 
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correlation value among the obtained correlation values has been obtained, is detected as a motion vector, it is 
not possible to detect a motion vector with precision higher than a quantization interval of each of the shifts for 
which correlation values are obtained. 

SUMMARY OF THE INVENTION 5 

The present invention has been made in consideration of the above problems. It is therefore an object of the 
present invention to provide an image motion vector detecting apparatus capable of stably detecting a motion 
vector irrespective of adverse effects of noises and the like, efficiently detecting a motion vector with a small 
amount of calculation, stably detecting a motion vector irrespective of a change in reference level of image 
signals and a change in contrast, and detecting a motion vector with precision higher than a conventional 10 
value. 

Further according to the present invention, in order to achieve the objects of stably detecting a motion 
vector irrespective of adverse effects of noises and the like and efficiently detecting a motion vector with a 
small amount of calculation, among the above-described objects, there is provided at least a low-pass filter 
which suppresses a spatial high frequency component of an image signal in one or both of the horizontal and 15 
vertical directions. Thereafter, the image signal with its high frequency component being suppressed is used 
for matching purpose to thereby detect a motion vector. 

With the above arrangement, the high frequency component of an image signal is suppressed so that the 
adverse effects by noises are suppressed during the matching operation. Therefore, a possibility of detecting 
an erroneous motion vector can be made vary small. In addition, even for those image signals whose change is 20 
concentrated such as on an edge portion of a step waveform, the low-pass filter can delay the change 
component of image signals concentrated on the edge portion up to the portion of the most area of the other 
image field. Therefore, it becomes possible to detect a motion vector even with a less number of 
representative points so that the motion vector can be detected with a small amount of calculation, at high 
efficiency and high stability. & 

According to the present invention, to achieve the object of stably detecting a motion vector irrespective of 
a change in reference level of image signals and a change in contrast, among the above-described objects, 
there is provided at least a high-pass filter which suppresses a spatial low frequency component of an image 
signal in one or both of the horizontal and vertical directions, or two separate high-pass filters which suppress 
a spatial low frequency component of an image signal in the horizontal and vertical directions, respectively, the 30 
outputs of the two high-pass filters being added together. Thereafter, the image signal with its low frequency 
component being suppressed is used for matching purpose to thereby detect a motion vector. 

Now, an image signal is considered from a spatial frequency component viewpoint. An error of a motion 
vector caused by a change in reference level of image signals or a change in contrast is proportional to the 
wavelength of a spatial frequency component signal. Therefore, in the above arrangement wherein the image 35 
signal with its low frequency component being suppressed by the high-pass filter is used for matching 
purpose to thereby detect a motion vector, it is possible to stably detect a motion vector within a 
predetermined error tolerance irrespective of a change in reference level of image signals and a change in 
contrast. 

Furthermore, according to the present invention, to achieve the object of detecting a motion vector with 40 
precision higher than a conventional value, among the above-described objects, a correlation value is obtained 
through matching operation based on discrete shifts. Based on the obtained correlation values, a correlation 
value for continuous shifts is estimated by means of interpolation. A shift having a minimum correlation value is 
detected as a motion vector. 

With the above-described arrangement, it becomes possible to detect a motion vector having precision 45 
higher than the interval of a discrete shift from which a correlation value is obtained through matching 
operation. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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Fig. 1 is a block diagram showing the outline of a first embodiment of an image motion vector detecting 
apparatus according to the present invention; 

Figs. 2(a) and 2(b) are explanatory diagrams used for explaining the operation of the embodiment ; 

Figs. 3(a)* 3(b) and 3(c) are graphs used for explaining the advantages of the embodiment; 

Figs. 4 (a) to 4{e) and Figs. 5(a) to 5(d) are explanatory diagrams used for explaining the operation of 55 
the embodiment; 

Fig. 6 is a graph used for explaining the advantages of the embodiment ; 

Figs. 7 (a), 7(b) and 7(c) are graphs used for explaining the advantages of the first and second 
embodiments; 

Fig. 8 is a block diagram showing the outline of a second embodiment of the image motion vector 60 
detecting apparatus according to the present invention; 

Figs. 9(a), 9(b) and 9(c) are explanatory diagrams used for explaining the operation of the embodiment; 

Figs. 10(a) and 10(b) and Fig. 11 are explanatory diagrams used for explaining the operation of the 
embodiments of this invention and a conventional apparatus; and 

Fig. 12 is a block diagram showing the outline of a conventional image motion vector detecting 65 
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apparatus. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A first embodiment of an image motion vector detecting apparatus of this invention will be described with 
5 reference to the accompanying drawings. 

Fig. 1 is a block diagram showing the image motion vector detecting apparatus of the first embodiment. As 
shown in Fig. 1, the motion vector detecting apparatus is constructed by an image signal input terminal 1, a 
low-pass filter 12 t a high-pass filter 13, a representative point memory 2, a subtracter 3, an absolute value 
converter 4, a cumulative adder 5, a minimum value point detector 6, and a motion vector calculator 14. 
to In the operation thereof, time sequential image signals for each field are applied to the image signal input 
terminal 1. An image signal is an 8 bit digital signal obtained by sampling an NTSC signal at a frequency of 4 x 
Fsc (Fsc « 3.58 MHz). The low-pass filter 1 2 cuts the high frequency component of an inputted image signal in 
the horizontal and vertical directions in accordance with the following transfer function: 



H(U>, Z) = = y- X ; 

16 - 15 x z" 8-7'xo) 



20 In the above function, z and co represent one pixel delay in the horizontal direction and one line delay in the 
vertical direction, respectively. The above function is constructed by an infinite impulse response low-pass 
filter which can be fabricated with a simpler circuitry than a finite impulse response low-pass filter having a 
similar cut-off frequency. In order to detect a motion vector with high precision, the calculation is conducted 
on the 16 bit unit basis including 8 bits under the decimal point, and the output signal is of a 10 bit signal 

25 including 2 bits under the decimal point. 

The high-pass filter 13 cuts the low frequency component of a signal outputted from the low-pass filter 12 in 
accordance with the following transfer function. This high-pass filter 13 is constructed by two separate 
high-pass filters which suppress the high frequency component of the signal in the horizontal and vertical 
directions, respectively, the outputs of the two high-pass filters being added together as follows. 

30 H(g>, z) = (1 -z-16) + (i -co-8) 

In cooperative association with the representative point memory 2, a plurality of representative points 7, T 
are predefined within the detection area of the image frame as shown in Fig. 11. The representative point 
memory 2 is therefore adapted to store therein pixel signals of the inputted image signals at the representative 
points. Upon input of image signals of the next field, the subtracter 3 obtains a difference AL(i.j) between a 

35 pixel signal at a representative point at the preceding field and a pixel signal at the current field shifted by i in 
the horizontal direction and by j in the vertical direction from that representative point. The i and j are assumed 
here one pixel interval and one line interval, respectively. The absolute value converter 4"converts the 
difference into an absolute value j AL(i,j) I . The cumulative adder 5 cumulatively adds signals from the absolute 
value converter for each shift (i,j) and stores them in its table as shown in Fig. 10(a). Each cumulatively added 

40 value I AL(iJ) | is used as a correlation value for a shift (i,j). The minimum value point detector 6 detects a shift 
(i'.f) which takes a minimum correlation value. The minimum correlation value and neighbouring correlation 
values for shifts (M.f), (i' + 1, j'), (i', j'-1), and (i', j' + 1) are outputted to the motion vector calculator 14. Using 
the inputted correlation values, the motion vector calculator 14 interpolates the correlation values by using a 
function 110. The minimum value point (i", j") 111 of the interpolated correlation value is obtained using the 

45 following formulas and outputted as a motion vector, 
i" = i' + 0.5 x (a-b)/max (a, b) 
j" « j' + 0.5 x (c-d)/max (c, d) 
where 

a-E|AL<MJ')| - E| AL(J' J') I 
50 b «S|AL(i'-M,j')| -Z|AL(i\j')| 

c = E|AL(i',j'-1)| -S|AL(i',j')l 

d = E|AL(i',j'-M)| - E|AL(i\j')| and max (a, b) denotes an operation of obtaining a maximum value 
between a and b. 

With the above arrangement, the high frequency component of an image signal is suppressed so that the 
55 adverse effects by noises are suppressed during the matching operation. Therefore, a possibility of detecting 
an erroneous motion vector can be made vary small. In addition, even for those image signals whose change is 
concentrated such as on an edge portion of a step waveform, the low-pass filter can delay the change 
component of image signals concentrated on the edge portion up to the portion of the most area of the other 
image field. Therefore, it becomes possible to detect a motion vector even with representative points disposed 
60 at longer intervals so that the motion vector can be detected with a small amount of calculation, with high 
efficiency and high stability. 

Figs. 3(a) to 3(c) are graphs showing the experimental results for confirming the advantages of suppressing 
the high frequency component in detecting a motion vector for a noisy image. In Figs. 3(a), the abscissa 
represents an image S/N, and the ordinate represents an average error value of detected motion vectors. 
65 Fig. 3(a) shows the resultant average error values obtained with and without a low-pass filter of the 
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embodiment, and obtained with a low-pass filter having an intermediate characteristic as expressed by the 
following transfer function: 



H(u), z) = ZT" x T]— 5 

4 - 3 x z 2-0) 

As is apparent from Fig. 3(a), it can be understood that a motion vector can be detected with higher precision if 
a low-pass filter is used. Each of Figs. 3(b) and 3(c) show the correct detection percentage of an image motion 
vector versus the number of representative points using an image S/N as the parameter, respectively for the 10 
cases without any low-pass filter and provided with the low-pass filter (LPF) of this embodiment. As is 
apparent from Figs. 3(b) and 3(c), it can also be understood that a motion vector can be detected with a less 
number of representative points and with high stability against noises if the low-pass filter is used. 

Figs. 4(a) to 4(e) are explanatory diagrams illustrating the operation of the embodiment wherein a change of 
an image signal having such as a step waveform is concentrated on its edge portion. Fig. 4(a) illustrates an 15 
example of the image for an image signal of a step waveform, wherein each of reference numerals 7 and 7' 
represent a representative point. Fig. 4(b) shows an image signal on a horizontal scan line passing through the 
representative points 7 and 7', wherein reference numeral 8 represents an interval between the representative 
points. If a matching operation is performed, in a conventional manner, between such image signal waveforms, 
based on the sampled values at the representative points 7 and 7', the resultant correlation values become as 20 
shown in Fig. 4(c). The portion indicated at 9 in Fig. 4(c) where the correlation value is minimum, has 
substantially the same length as the interval 8 between the representative points shown in Fig. 4(b). Therefore, 
a motion vector cannot be detected. However, by using the low-pass filter of this embodiment, the waveform 
shown in Fig. 4(b) is transformed as shown in Fig. 4(d) so that the varying components of the image signal 
concentrating on the edge portion can be extended onto a greater part of the other image area. If a matching 25 
operation is performed between such image signal waveforms, based on the sampled values at the 
representative points 7 and T as shown in Fig. 4(d), the resultant correlation values become as shown in 
Fig. 4(e). A motion vector can be detected correctly with a very small number of representative points by 
obtaining a minimum value point 131 of the correlation values. 1 

In the above arrangement wherein the image signal with its d.c. and low frequency components being 30 & 
suppressed by the high-pass filter is used for the matching purpose to thereby detect a motion vector, it is 
possible to stably detect a motion vector within a predetermined error tolerance irrespective of a change in 
reference level of image signals and a change in contrast. 

Figs. 5(a) to 5(d) are explanatory diagrams used for explaining the operation of the embodiment wherein the 
gain for an image signal varies. Fig. 5(a) shows an variation in gain of an image signal, wherein reference 35 
numeral 7 and T represent representative points. If a matching operation is performed, in a conventional 
manner, between such gain varying image signal waveforms, based on the sampled values at the '* ^ 

representative points 7 and 7', the resultant correlation values become as shown in Fig. 5(b). Since the & 
waveform shown in Fig. 5(a) does not shift in the horizontal direction, a correct motion vector is a zero vector. * 
However, a minimum point of the correlation value is present in the obtained correlation values as shown at 40 < & 

131 in Fig. 5(b), resulting in an erroneous image motion vector. However, in the embodiment using the * 
high-pass filter, the waveform shown in Fig. 5(a) is transformed as shown in Fig. 5(c). Therefore, if a matching 
operation is performed between such gain changed image signal waveforms, based on the sampled values at 
the representative points 7 and 7', the resultant correlation values become as shown in Fig. 5(d). A generally 
correct motion vector can thus be detected by obtaining a minimum value point of the correlation value. 45 

Fig. 6 is a graph showing an experimental result for confirming the advantages of suppressing a low 
frequency component in detecting a motion vector for gain varying images. In Fig. 6, the abscissa represents 
the gain regulation of images between fields and the ordinate represents average error values of detected 
motion vectors, respectively, for both images having high contrast and low contrast. Fig. 6 also shows a 
comparison between the cases with and without the high-pass filter as described in the embodiment. As is 50 
apparent from Fig. 6, a motion vector can be detected at higher precision and higher stability against gain 
variations, when the high-pass filter is used. 

Variations in gain, reference level and contrast of image signals are often caused by a change in the aperture 
of an image pickup camera, a change in gain of a signal processing system, a change of illumination, flicker or 
the like. Even under these circumstances, the present invention enables stable and precise detection of an 55 
image motion vector. 

In the above arrangement wherein a correlation value is obtained through the matching operation based on 
discrete shifts, based on the obtained correlation value having a minimum correlation value and neighbouring 
correlation values, a correlation value for consecutive shifts is estimated by means of interpolation. And, a shift 
having a minimum correlation value is detected as a motion vector. Therefore, it becomes possible to detect a 60 
motion vector having precision higher than the interval of a discrete shift from which a correlation value is 
obtained through the matching operation. Figs. 7(a) and 7(b) show the result of simulation for confirming the 
advantage of such detection. In obtaining the result shown in Figs. 7(a) and 7(b), the optical axis of a camera 
was swung sinusoidally to pick up an image signal representing a swinging image and to detect a motion 
vector. The result according to a conventional example is shown in Fig. 7(a), and the result according to the 65 
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present embodiment is shown in Fig. 7(b). In this case, four detection regions were prepared within an image 
frame to detect motion vectors for respective detection regions, and the average value of the four motion 
vectors excepting the maximum and minimum values thereof was calculated both in the horizontal and vertical 
directions to use it as a motion vector for the whole image frame. In Figs. 7(a) to 7(c), reference numeral 1 12 
5 represents a detected motion vector, 113 a sine wave representing a fluctuating image, and 114 a detected 
error. As is apparent from the results shown in Figs. 7(a) and 7(b), it can be understood that, according to the 
present embodiment, an image motion vector can be detected with higher precision than conventional 
precision. 

A second embodiment of an image motion vector detecting apparatus of this invention wili be described 
10 with reference to the accompanying drawings. 

Fig. 8 is a block diagram showing the image motion vector detecting apparatus of the second embodiment. 
As shown in Fig. 8, the motion vector detecting apparatus is constructed by an image signal input terminal 1 , a 
frequency divider 15, low-pass filters 12 and 12', a high-pass filter 13, a representative point memory 2, a 
subtracter 3, an absolute value converter 4, a cumulative adder 5, a minimum value point detector 6, and a 
15 motion vector calculator 14. 

In operation, time sequential image signals for each field are applied to the image signal input terminal 1. An 
image signal is an 8 bit digital signal obtained by sampling an NTSC signal at a frequency of 4 x Fsc (Fsc = 3.58 
MHz). The low-pass filter 12 cuts the high frequency component of an inputted image signal in the horizontal 
direction in accordance with the following transfer function: 



H(u>, z) = 



16 - 15 x z 1 



The low-pass filter 12' removes the odd number signal of an inputted signal at the sampling frequency of 4 x 
Fsc, with the aid of the frequency divider 15, to thereby obtain a signal having a frequency of 2 x Fsc. The high 
frequency component of the obtained signal is cut in the vertical direction in accordance with the following 
transfer function: 



H(u), z) = 



8 - 7 x uT 1 



In the above function, z and co represent one pixel delay in the horizontal direction and one line delay in the 
vertical direction, respectively. The above function is constructed by an infinite impulse response low-pass 
filter which can be fabricated with a simpler circuitry than a finite impulse response low-pass filter having a 
similar cut-off frequency. In addition, the capacity of a line memory required by the low-pass filter 12' for the 
40 vertical direction can be halved, because the frequency of the signal is made 2 x Fsc by using the frequency 
divider 15. In order to detect a motion vector with high precision, the calculation is conducted on the 16 bit unit 
basis including 8 bits under the decimal point, and the output signal is of a 10 bit signal including 2 bits under 
the decimal point. 

The high-pass filter 13 cuts the low frequency component of a signal outputted from the low-pass filter 12' in 

45 accordance with the following transfer function. This high-pass filter 13 is constructed by two separate 
high-pass filters which suppress the high frequency component of the signal in the horizontal and vertical 
directions, respectively, the outputs of the two high-pass filters being added together. 
H(cd, z) = (1 -z-16) 4. (1 -co-8) 

In cooperative association with the representative point memory 2, a plurality of representative points 7, 7' 

50 are predefined within the detection area of the image frame as shown in Fig. 11. The representative point 
memory 2 is therefore adapted to store therein pixel signals of the inputted image signals at the positions of 
the representative points. Upon inputting of image signals of the next frame, the subtracter 3 obtains a 
difference AL(ij) between a stored pixel signal at the position of a representative point in the preceding field 
and a pixel signal in the current field shifted by \ in the horizontal direction and by ] in the vertical direction from 

55 the preceding field representative point. The i and J are assumed here two pixel interval and one line interval, 
respectively. The absolute value converter 4 converts the difference into an absolute value |AL(ij)|. The 
cumulative adder 5 cumulatively adds signals from the absolute value converter at every shift (i,j) and stores 
them in a table, which is provided in the cumulative adder 5 and which corresponds to respective shifts (ij), as 
shown in Fig. 10(b). Each cumulatively added value I AL(i,j) | is used as a correlation value for a shift (i,j). As 

60 shown in Fig. 10(b), the memory capacity of the table for respective shifts (i,j) is also halved as compared with 
the conventional memory capacity shown Fig. 10(a). The minimum value point detector 6 detects a shift (i\j') 
which takes a minimum correlation value. The minimum correlation value and neighbouring correlation values 
for the shifts (i'-2 f j'), (i' + 2, j'), (i' ,j'-1), and (i'.j' + 1) are outputted to the motion vector calculator 14. Using the 
inputted correlation values, the motion vector calculator 14 interpolates the correlation values by using a 

65 function 1 10 as shown in Fig. 2(b). The minimum value point (i", j") 1 1 1 of the interpolated correlation value is 
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obtained using the following formulas and outputted as a motion vector, 
i" - i' + 1.0 x (a-b)/max (a, b) 
j" » j' + 0.5 x (c-d)/max (c f d) 
where 

a - E|AL(i'-2,j')| -IIAL(i',j')l 5 
b - I|AL(i' + 2 1 j')l -L|AL(i'J')| 
c - E|AL(i',j'-1)l -IIAL{i'j')l 

d = S|AL(i',j' + 1) -ZIAL(i',j')l and max (a, b) denotes an operation of obtaining a maximum value 
between a and b. 

With the above arrangement, the high frequency component of an image signal is suppressed in the 10 
horizontal direction, and thereafter, the frequency is changed from 4 x Fsc to 2 x Fsc by using the frequency 
divider 15. Therefore, the amount of calculation is approximately halved. The capacity of the line memory for 
the low-pass filter 12\ the memory capacity of the table in the cumulative adder 5, and the like can also be 
halved to accordingly realize the motion vector detecting apparatus with a simpler circuitry. In addition, the 
operation speed required for the circuits from the low-pass filter 12' to the minimum value point detector 6 is 15 
halved, thus making it possible to realize the apparatus more easily. 

in the above arrangement, the motion vector calculator 14 estimates a correlation value for continuous shifts 
by means of interpolation based on a minimum correlation value and neighbouring correlation values, and a 
shift having a minimum estimated correlation value is calculated to detect it as a motion vector. Therefore, it 
becomes possible to detect a motion vector having higher precision than a conventional value, even if the 20 
interval for obtaining correlation values is made to be two pixels in the horizontal direction. Figs. 7(a) and 7(c) 
show the result of simulation for confirming the advantage of such detection. In obtaining the result shown in 
Figs. 7(a) and 7(c), the optical axis of a camera was swung sinusoidally to pick up an image signal representing 
a swinging image and to detect a motion vector. The result according to a conventional example is shown in 
Fig. 7(a), and the result according to the present embodiment is shown in Fig. 7(c). In this case, four detection 25 
regions were prepared within an image frame to detect motion vectors for respective detection regions, and 
the average value of the four motion vectors excepting the maximum and minimum values thereof was 
calculated both in the horizontal and vertical directions to use it as a motion vector for the whole image frame. 
As is apparent from the results shown in Figs. 7(a) and 7(c), it can be understood that according to the present 
embodiment, an image motion vector can be detected at higher precision and with a smaller detected error 30 
1 14 than conventional values, irrespective of the fact that the interval for obtaining correlation values is made 
two pixels in the horizontal direction. 

The low-pass filters 12 and 12' used in the first and second embodiments of this invention have the 
advantage of not only suppressing the adverse effects of noises but also making small the error of a calculated 
motion vector. Figs. 9(a) to 9(c) are explanatory diagrams used for explaining the advantage of the present 35 
invention. In Fig. 9(a), it is assumed that an inputted image signal is a sine wave having a wavelength of X. Fig 
9(b) shows a relationship between the shift (i) and the correlation value HAL I (i) of the inputted image signals 
with respective to continuous values of i. In Fig. 9(b), reference numeral 115 represents an image motion 
vector v, 116 a detected motion vector i' according to a conventional example with the interval for obtaining 
correlation values being set at ix, and 117 a detected motion vector i" according to the present embodiment. 40 
Fig. 9(c) shows a relationship between the maximum detection errors (max |v-i'|) 118 and (max I v-i" 1)119, 
respectively, of the conventional example and the present embodiment, the interval Ix, and the wavelength X. 
As seen from Fig. 9(c), the maximum detection error of this embodiment becomes larger as the value (IxA,) 
becomes larger. At X = 2 x Ix, the maximum detection error of this embodiment becomes equal to the 
maximum detection error in the conventional example. An image signal contains in practice various 45 
wavelength components, particularly middle and low frequency components. Therefore, even if the low-pass 
filter is not used, the present embodiments can detect a motion vector with precision higher than a 
conventional value. However, a motion vector can be more stably detected if the low-pass filter is used to 
suppress the high frequency component of an inputted image signal in the horizontal direction, particularly the 
high frequency component near the frequency F = 1/(2 x Ix). Similarly, as to the vertical direction, a motion 50 
vector can be detected with higher precision by suppressing the high frequency component, particularly the 
high frequency component near and higher than the frequency F « 1/(2 x ly), with the interval for obtaining 
correlation values being set at ly. 

In the second embodiment, the interval for obtaining correlation values has been set as two pixels in the 
horizontal direction and one line in the vertical direction. The interval may take any other value. For instance, 55 
the interval for obtaining correlation values may be set to be four pixels in the horizontal direction and one line 
in the vertical direction, or to be two pixels in the horizontal direction and two lines in the vertical direction. 

In the second embodiment, the data amount of image signals is halved at the low-pass filter 12' with the aid 
of the frequency divider 15. This process may be carried out at the different stage. For instance, the data 
amount may be halved with a trap or the like, immediately after image signals are inputted. Alternatively, the 60 
data amount may be halved at the stage where a difference between image signals is obtained at the 
subtracter 3, by using a frequency divider or the like. 

In the first and second embodiments, although the representative point matching method is used for 
obtaining a correlation value, a whole point matching method may be used. Also in the first and second 
embodiments, although the subtracter 3 and absolute value converter 4 are used for obtaining an absolute 65 
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value I AL I of a difference between two signals, a multiplier may be used for obtaining a product of two signals. 
In this case, a maximum value point detector is used instead of the minimum value point detector 6, and the 
motion vector calculator 14 obtains a maximum value point of an upward projecting virtual function, instead of 
a minimum value point of a downward projecting virtual function as shown in Figs. 2(a) and 2(b). Further in the 
first and second embodiments, although the motion vector calculator 14 obtains a minimum value point of the 
function as shown in Figs. 2(a) and 2(b), another function such as a second-order function may be used. The 
motion vector calculator 14 may be adapted to compensate a motion vector for a certain amount in the 
direction from an optimum point to a point having a value near the optimum point among the points around the 
optimum point, instead of obtaining a minimum or maximum point of a virtual function. In the first and second 
embodiments, although the motion vector calculator 14 calculates a motion vector using only the minimum 
point value and four neighbouring point values, other point values may be used instead. For instance, obliquely 
disposed four points adjacent to the minimum point may be used, or the four neighbouring points and 
obliquely disposed four points, that is, eight points in total and the minimum point may be used, or the points in 
a broader range about the minimum point may also be used. In the second embodiment, the interval for 
obtaining correlation values are set to be two pixels in the horizontal direction and one line in the vertical 
direction. However, the interval may be set to be any other combination of values. For instance, the interval 
may be set to be two pixels in the horizontal direction and two lines in the vertical direction, four pixels in the 
horizontal direction and two lines in the vertical direction, and on on. In the first and second embodiments, the 
interval for obtaining correlation values is set to be a constant value. However, this interval is not necessarily 
required to be set to have a constant value. For instance, the interval may be made shorter in a certain portion 
within a detection area for a motion vector, and made longer in the other portion. This invention is also 
applicable to such a case having different intervals. 

In the first and second embodiments of this invention, an image signal is used which is an 8 bit digital signal 
obtained by sampling an NTSC signal having a frequency of 4 x Fsc (Fsc « 3.58 MHz). It is apparent that the 
present invention is also effective even if a signal having a different sampling frequency or a different bit 
number, or a moving image signal other than an NTSC signal is used. Further, in the first and second 
embodiments of this invention, a motion vector for time sequentially consecutive fields is detected. However, a 
motion vector of images at two fields which are spaced apart by several fields may be detected. 

In the first and second embodiments of this invention, a combination of the low-pass filter 12, high-pass filter 
13 and motion vector calculator 14 is used. Obviously, these circuits may be used independently or in any 
desired combination, while retaining their respective advantages. The characteristics of these filters 12 and 13 
may have other characteristics different from those shown in the embodiments. For instance, the 
characteristic of the low-pass filter 12 expressed by the following function may also be used: 



Also, the characteristic of the high-pass filter 13 expressed by the following function which suppresses the 
d.c. and high frequency components in the horizontal direction may also be used: 
H(co, z) - 1 -z" 16 

Further, in the first and second embodiments of this invention, the low-pass filter 12 and high-pass filter 13 
are used separately. It is apparent that the same advantages can be obtained even if a band-pass filter having 
the characteristics of the low-pass and high-pass filters in combination is used. Furthermore, the 
oharacteristics of the filters are not necessary to be strictly the same as those described in the embodiments. 
For instance, an optimum filter characteristic may be set depending upon the sampling frequency of an image 
signal, the S/N, desired detection precision, or the like. 

The same advantages of this invention can be obtained either in the case where the motion vector detecting 
apparatus is realized using discrete circuits or in the case where the image processing is performed with 
software using a computer to detect a motion vector. 

The advantages obtained by the present invention are as follows. 

As described so far, the present invention can easily realize an image motion vector detecting apparatus 
with a simple circuitry. Further, in the case where the image processing is performed with software using a 
computer to detect a motion vector, the amount of calculation can be reduced, and a motion vector can be 
efficiently detected. Furthermore, a precise motion vector can be stably detected irrespective of noises, a 
change in reference level of image signals, and a change in contrast, with precision higher than a conventional 
value. Therefore, an image motion vector detecting apparatus for various video apparatuses becomes 
available with high reliability and high precision and at low cost. 



1 . An image motion vector detecting apparatus comprising: 
at least a one-dimensional or two-dimensional low-pass filter (12, 12') for suppressing a high frequency 
component of image information at least in one of the horizontal and vertical directions; 
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means (2 - 5) for obtaining correlation values for image signals shifted between two fields which image 
signals have passed through said low-pass filter; and 

means (6, 14) for detecting an image motion vector based on said correlation values. 

2. An image motion vector detecting apparatus comprising: 

at least a one-dimensional or two-dimensional high-pass filter (13) for suppressing a d.c. and low 5 
frequency components of image information at least in one of the horizontal and vertical directions; 
means (2 - 5) for obtaining correlation values for image signals shifted between two fields which image 
signals have passed through said high-pass filter; and 

means (6, 14) for detecting an image motion vector based on said correlation values. 

3. An image motion vector detecting apparatus comprising : 10 
a band-pass filter for suppressing a d.c, low frequency and high frequency components of image 
information at least in one of the horizontal and vertical directions and extracting a predetermined 
bandwidth component of the image information; 

means (2 - 5) for obtaining correlation values for image signals shifted between two fields which image 
signals have passed through said high-pass filter; and 15 
means (6, 14) for detecting an image motion vector based on said correlation values. 

4. An image motion vector detecting apparatus according to claim 1, wherein said one-dimensional or 
two-dimensional low-pass filter (12, 12') includes an infinite impulse response low-pass filter. 

5. An image motion vector detecting apparatus according to claim 2, wherein said one-dimensional or 
two-dimensional high-pass filter (13) picks up a difference between adjacent pixels or between pixels 20 
spaced apart from each other through a predetermined interval. 

6. An image motion vector detecting apparatus according to claim 1, wherein said low-pass filter 
performs under-fioating-point computation on a bit number of an inputted image signal and outputs a 
signal having at least one bit added under the decimal point or a signal having a gain of 2 and higher. 

7. An image motion vector detecting apparatus according to claim 3, said band-pass filter performs 25 
under-floating-point computation on a bit number of an inputted image signal and outputs a signal having 

at least one bit added under the decimal point or a signal having a gain of 2 and higher. 

8. An image motion vector detecting apparatus comprising: 

means (12, 12', 13, 2-5) for obtaining correlation values for image signals shifted between two fields 

through a predetermined interval over the whole or a part of an image frame; 30 £ 

means (6) for detecting a minimum or maximum point which is an optimum point of the correlation values; ^ 

and & 

means (14) for calculating a motion vector based on a position corrected for a certain amount in the m 

direction from the optimum point to a point among the points about the optimum point which has a value 

relatively near that of the optimum point. 35 

9. An image motion vector detecting apparatus according to claim 8, wherein said predetermined 
interval is set to be one pixel in the horizontal direction and one line in the vertical direction. 

10. An image motion vector detecting apparatus according to claim 8, wherein said predetermined 
interval is set to be two or more pixels in the horizontal direction and one line in the vertical direction, to be 

one pixel in the horizontal direction and two or more lines in the vertical direction, or to be two or more 40 

pixels in the horizontal direction and two or more lines in the vertical direction. £ 

1 1 . An image motion vector detecting apparatus according to claim 8, wherein, when said predetermined 
interval is set to be Ix in the horizontal direction and ly in the vertical direction, provided at a preceding 
stage of said means for obtaining a correlation value is a low-pass filter for the horizontal direction having 

a cut-off frequency equal to or lower than 1/(2 x Ix), a low-pass filter for the vertical direction having a 45 
cut-off frequency equal to or lower than 1/(2 x ly), or a two-dimensional low-pass filter having both above 
filter characteristics. 

12. An image motion vector detecting apparatus according to claim 1 , 2, 3 or 8, wherein said means for 
obtaining a correlation value is a matching method using a representative point. 

50 
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© Image motion vector detecting apparatus. 



© An image motion vector detecting apparatus in- 
cludes a low-pass filter (12, ^2) for suppressing a 
spatial high, frequency component of an image signal 
in one or both of the horizontal and vertical direc- 
tions, and a high-pass filter (13) for suppressing a 
spatial low frequency component of an image signal 
in one or both of the horizontal and vertical direc- 
tions. Using an image signal which has passed 



through the filters, a correlation value for discrete 
shifts is obtained through a matching operation. 
Based on the obtained correlation values, a correla- 
tion value for continuous shifts is estimated through 
interpolation processing. A shift having a minimum 
correlation value is calculated to detect an image 
motion vector. 
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